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Abstract — Robust control design for quantum systems has 
been recognized as a key task in the development of practical 
quantum technology. In this paper, we present a systematic 
numerical methodology of sampling-based learning control (SLC) 
for control design of quantum systems with uncertainties. The 
SLC method includes two steps of “training” and “testing”. In the 
training step, an augmented system is constructed using artificial 
samples generated by sampling uncertainty parameters according 
to a given distribution. A gradient flow based learning algorithm 
is developed to find the control for the augmented system. In 
the process of testing, a number of additional samples are tested 
to evaluate the control performance where these samples are 
obtained through sampling the uncertainty parameters according 
to a possible distribution. The SLC method is applied to three 
significant examples of quantum robust control including state 
preparation in a three-level quantum system, robust eutangle- 
ment geueratiou in a two-qubit superconducting circuit and 
quantum entanglement control in a two-atom system interacting 
with a quantized field in a cavity. Numerical results demonstrate 
the effectiveness of the SLC approach even when uncertainties 
are quite large, and show its potential for robust control design 
of quantum systems. 

Index Terms — Quantum control, sampling-based learning con¬ 
trol (SLC), quantum robust coutrol, entanglement 


I. Introduction 

The control and manipulation of quantum phenomena lie 
at the heart of developing practical quantum technologies, 
and the exploration of quantum control theory and methods 
is drawing wide interests from scientists and engineers m- 
a. In the development of practical quantum technologies, 
robustness has been recognized as a key performance measure 
since the existence of uncertainties and noises is unavoidable 
in the modeling and control process for real quantum systems 
0-ii. For example, the chemical shift may not be exactly 
known in the model of a spin system in nuclear magnetic 
resonance (NMR) El, El. In a superconducting quantum 
circuit, there exist possible fluctuations in the coupling energy 
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of a Josephson junction EH, Ea. In the dipole approxi¬ 
mation for a molecular system interacting with laser fields, 
imprecision in the model parameters is unavoidable ES- It is 
also common that there exist errors in control pulses or fields 
applied to quantum systems. Hence, it is important to develop 
systematic robust design methods for the analysis and synthe¬ 
sis of quantum systems with uncertainties. Several methods 
have been proposed for the robust control of quantum systems 
Ei-iiia. For example, James et al. El have formulated 
and solved an H°° controller synthesis problem for a class 
of quantum linear stochastic systems. Adiabatic techniques 
(e.g., STIRAP - stimulated Raman adiabatic passage) Ezl- 
OTll have been widely applied to robust control problems of 
quantum systems when the adiabatic limit can be satisfied. 
Optimized composite pulses have been applied in NMR to 
improve robustness performance El, M- A noise Altering 
approach has been presented to enhance robustness in quantum 
control m. A sequential convex programming method has 
been proposed for designing robust quantum gates 01 . A 
sliding mode control approach has been presented to deal with 
Hamiltonian uncertainties in two-level quantum systems ESI, 

EH- 

In classical (non-quantum) control systems, feedback con¬ 
trol is the dominant method for robust control design. Feed¬ 
back control (including measurement-based feedback control 
and coherent feedback control) has been applied to some 
quantum systems for improved control performance El, ESl- 
BOll . However, open-loop control is more practical than feed¬ 
back control for most quantum systems with current tech¬ 
nology considering the small time scales and measurement 
backaction in the quantum domain B4ll . Several open-loop 
control strategies have been presented to design robust control 
laws for specific quantum systems. For example, dynamical 
decoupling has been developed for control design of quantum 
systems with uncertainties ED-iia. Existing results showed 
that control fields designed by learning have the property 
of robustness Eli, El, ll45l . Recently, Zhang et al. 1461 
employed a gradient-based algorithm to design robust control 
pulses for electron shuttling. They considered that parameter 
uncertainties exist in the energy difference when an electron is 
transported along a chain of donors. An effective optimization 
algorithm has been developed to And robust control pulses by 
discretizing the uncertainty range and deriving the gradient of 
an aggregate fidelity with respect to sinusoidal control fields 

na. 

In this paper, we present a systematic numerical method¬ 
ology of sampling-based learning control (SLC) for robust 
design of quantum systems with uncertainties. Sampling-based 
learning control was first presented for control design of 
inhomogeneous quantum ensembles where the SLC method 
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includes two steps of “training” and “testing” Ez). A general¬ 
ized system is constructed from some samples with different 
values of the inhomogeneous parameters in the training step 
and a control field is learned through a gradient flow based 
optimization algorithm. The control is evaluated using addi¬ 
tional samples for some possible values of the inhomogeneous 
parameters. The results showed that the SLC approach can And 
an effective control law to drive the members in an inhomoge¬ 
neous ensemble to a given target state with high fidelity. In this 
paper, we contribute a systematic SLC method with specific 
learning algorithms for the robust control of quantum systems 
with uncertainties. In particular, we generate artificial samples 
by sampling the uncertainty parameters in the system model 
and construct an augmented system using these samples in 
the training step HSi . Then a gradient flow based learning and 
optimization algorithm is developed to learn a control law with 
desired performance for the augmented system. In the process 
of testing, we test a number of samples of the uncertainties to 
evaluate the control performance. The SLC method is applied 
to three significant examples of quantum robust control. The 
first example is a three-level quantum system that is found 
widely in natural atoms and artificial atoms B9l . A problem 
of state preparation is investigated when uncertainties exist 
in the three-level system. In the second example, we consider 
superconducting quantum circuits which have been recognized 
as promising candidates for quantum information processing 
due to their advantages of scalability and design flexibility 
(see, e.g., Il50l . ifSTl . Il5^ . ifSBl l. In particular, we employ 
the SLC method to learn a robust control law that can be 
applied to a two-qubit superconducting circuit for generating 
quantum entanglement. The third example investigates the 
application of the SLC approach to the robust control of 
quantum entanglement in a two-atom system interacting with 
a quantized held in a cavity (n, Ea. Numerical results show 
that the SLC method is effective for robust control design of 
these classes of quantum systems with uncertainties. 

This paper is organized as follows. Sectionllllformulates the 
quantum control problem. Section |III] presents the sampling- 
based learning control approach and introduces a gradient flow 
based learning algorithm. Numerical results on control design 
in three-level quantum systems are presented in Section |IV] 
The SLC method is applied to robust entanglement generation 
in a two-qubit superconducting circuit in Section |V] In Section 
IVII the SLC approach is used to learn a robust control law for a 
two-atom system interacting with a quantized held in a cavity. 
Concluding remarks are presented in Section I VII I 

11. Problem formulation of quantum robust 

CONTROL 

We focus on a finite-dimensional quantum system that 
can be approximated as a closed system and whose state is 
described using a complex vector ji//) or a density operator 
P = I'/)(’/! iti underlying Hilbert space. The evolution of 
its state |i/(f)) can be described by the following Schrodinger 
equation: 

lr(0)) = |v^o). 


The dynamics of the system are governed by a time-dependent 
Hamiltonian of the form ||5^ 

M 

H{t)=Ho+H,{t)=Ho+ Y. ( 2 ) 

m=l 


where Hq is the free Hamiltonian of the system, Hc{t) = 
Y!^i= \ Um{t)Hm is the time-dependent control Hamiltonian that 
represents the interaction of the system with the external fields 
(scalar functions), and the H,„ are Hermitian operators 
through which external controls couple to the system. 

The solution of ([T]i is given by |i/(f)) =t/(f)|v/b). where 
the propagator U{t) satisfies 


U{0)=I. 


(3) 


For an ideal model, there exist no uncertainties in (|2]i. 
However, for a practical quantum system, the existence of 
uncertainties is unavoidable due to external disturbances, im¬ 
precise models and errors in control fields. In this paper, we 
suppose that the system Hamiltonian has the following form 


M 

H&{t) = foWHo + Y ( 4 ) 

m=l 

We have denoted 0 = (0o, 0i, ■ ■ ■, Pm) and the functions fj{9j) 
(7=0,1,... ,M) characterize possible uncertainties. For exam¬ 
ple, /o(0o) corresponds to uncertainties in the free Hamiltonian 
(e.g., due to chemical shift in NMR). f„,{9m) can characterize 
possible multiplicative noises in the control fields or imprecise 
parameters in the dipole approximation. When the fn{9m) are 
allowed to be time-dependent, the corresponding uncertainties 
may originate from time-varying errors in the control fields. 
For example, the time-dependent non-Markovian noise in the 
control held considered in EH can be described using the 
model. It is also straightforward to include additive noises in 
control fields by slightly modifying (01). We assume that fj{9j) 
are continuous functions of Oj and the parameters 9j could be 
time-dependent and 9j G [1 — £ 7,1 +£ 7 ]. For simplicity, we 
assume the uncertainty bounds £0 = • • • = £7 = • • • = Em = E 
are all equal in this paper. We assume that the nominal values 
of 9j are 1 and the fluctuations of the uncertainty parameters 
9j are 2£ (where £ € [0,1]). The objective is to design the 
controls {u,„{t),m = 1 , 2 ,...,M} to steer the quantum system 
with uncertainties from an initial state ly/b) to a target state 
IV4arget) with high fidelity. The fidelity between two quantum 
states |y/i) and |i^ 2 ) is deflned as ESl . E9l : 


F{\Wi),\¥2)) = \{Wi\¥2)\- (5) 


The control performance is described by a performance func¬ 
tion J{u) for each control strategy u = {um(t),m = 1,2,... ,M}. 
The control problem can then be formulated as a maximization 
problem as follows: 


max /(m) :=maxE|(v/(7’)|v/target)|^ 

U ll 

s-t. j^\¥it)) = -jH@{t)\¥it)), \¥iO)) = \¥o) 

M 

H&{t) = fo{9Q)Ho Y )H ,„, 

m=l 

with 07 e [i-£,i-b£], f e [o,r]. 


( 6 ) 
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Note that J{u) depends implicitly on the control u through the 
Schrodinger equation and E(-) denotes the expectation with 
respect to the uncertainty parameters © = ( 0 o, 0 i, ■ ■ ■, 0m)- 

III. Sampling-based learning control method 

Gradient-based methods 0, ED), ED have been success¬ 
fully applied to search for optimal solutions to a variety of 
quantum control problems, including theoretical and labo¬ 
ratory applications. In this paper, a gradient-based learning 
method is employed to optimize the control fields for quan¬ 
tum systems with uncertainties. However, it is impossible 
to directly calculate the derivative of J{u) since there exist 
uncertainties and some parameters in the model are unknown. 
Hence, we present a systematic numerical methodology of 
sampling-based learning control which includes two steps of 
“training” and “testing”. In the training step, some artificial 
samples are generated through sampling the uncertainty pa¬ 
rameters to construct an augmented system and a learning 
algorithm is developed to find an optimal control strategy 
for the augmented system. Then the designed control law is 
applied to additional samples to test and evaluate the control 
performance in the testing step. 

A. Sampling-based learning control 

In the training step, we first generate N samples through 
sampling the uncertainty parameters according to a given prob¬ 
ability distribution (e.g., the uniform distribution). We could 
choose any of the combination (0Ono! 0i«i i ■ ■ ■; of the 

sampled parameters {6j,j = 0,1,... ,M}, where Sjnj is a possi¬ 
ble value of the uncertainty parameter 9j, nj = 1,... ,Nj and Nj 
is the number of samples of the parameter 9j (j = 0,1,... ,M). 
The total number of potential samples is N = Y[f=oNj. We 
denote these different sample systems as {«} (n = 1,2,... ,N) 
and ©„ G {(0o«o>0i«i>■ • • >0 m«m)I”j = With these 

samples, we can construct an augmented system as follows 



( Iri(O) \ 



d 

1 ^ 2 ( 0 ) 

i 

HeMWiit)) 

dt 

V lw(f)) ) 

~ h 



where //©„(?) =/o( 0 o«o)^O + with n = 

1,2,...,N. The performance function for the augmented sys¬ 
tem is defined by 

Jn{u) •= ^ V^target)! • (8) 

■''' n=\ ■''' «=1 

The task of the training step is to find a control strategy u* 
that maximizes the performance function defined in Eq. 

We will develop a gradient flow based learning algorithm to 
solve this optimization problem in an iterative way HD, El. 
Assume that the performance function is Jn{u^) with an initial 
control strategy «** = {m® (f)}. We can apply the gradient flow 
method to obtain an (approximate) optimal control strategy 
«* = {«*,(?)}. It is clear that we may take u* as an approximate 
optimal control solution when Jn{u) —?> 1. For the nominal 
system (without uncertainties), the quantum control landscape 


theory ED has shown that there are no local maxima in 
the optimization problem for closed quantum systems when 
they are controllable and the critical points of their control 
landscapes are regular (for details, see, e.g., a, my For the 
augmented system, it may be also possible to use a similar 
method to the quantum landscape theory to prove the optimal 
characteristics. Numerical results in this paper show that a 
gradient method can be used to achieve excellent performance 
in finding an approximate optimal solution. The detailed 
gradient flow algorithm will be presented in Subsection IIII-BI 

As for the issue of choosing N samples, we generally choose 
them according to possible distributions of the uncertainty 
parameters 9j G [1 — £,1 -fF]. The basic motivation of the 
proposed sampling-based approach is to design the control law 
using some artificial samples instead of unknown uncertainties. 
Therefore, it is necessary to choose the set of samples that are 
representatives of these uncertainty parameters. 

For example, we consider the case with two uncertainty 
parameters 9o and 0i. If the distributions of both 9o and 
01 are uniform, we may choose equally spaced samples for 
00 and 01 . For example, the intervals [1 — £, 1-fF] for 9q 
and [1 — F, 1 -|-F] for 0i are divided into Aq -I-1 and Ai 4-1 
subintervals, respectively, where No and Ni are usually positive 
odd numbers. Then the number of samples is N = NoNi, and 
©H = ( 0 Ono) 0 ini) is chosen from the set of sample points 

&.€{(9o„o,9i„,): 0o„„ = l-F+(2^i^, 


noe{l,...,Ao}, ni G {!,...,Ai}}. (9) 

In practical applications, the numbers of Aq and Ai can be 
chosen by experience or through numerical computation. As 
long as the augmented system can model the quantum system 
with uncertainties and is effective to And the optimal control 
strategy, we prefer to choose small numbers for Aq and Ai 
to speed up the training process and simplify the augmented 
system. Numerical results show that five or seven samples for 
each uncertainty parameter are enough to achieve excellent 
performance. 

In the testing step, we apply the optimized control u* 
obtained in the training step to a large number of additional 
samples obtained through randomly sampling the uncertainty 
parameters. The control performance is evaluated for each 
sample in terms of the fidelity F(| (//(F)), | y/target)) between the 
final state | </(£)) and the target state | V^target)- If the fidelity for 
all the tested samples is satisfactory, we accept the designed 
control law and end the control design process. Otherwise, 
we go back to the training step to find another optimized 
control strategy by changing the settings (e.g., restarting the 
training step with a new initial control strategy or a new set 
of samples). 

B. Gradient flow based learning algorithm 

To find an optimal control strategy u* = {«*,(?),(? G 
[0,r]),m = 1 , 2 ,...,M} for the augmented system (|7]i, a good 
choice is to follow the direction of the gradient of Jn(u) as 
an ascent direction so as to speed up the learning process. For 










4 


ease of notation, we present the method for the case M = 1 . 
We introduce a time-like variable s to characterize different 
control strategies Then the gradient flow in the control 

space can be defined as 


ds 


= V7^(mW), 


( 10 ) 


where VJf^{u) denotes the gradient of Jn with respect to 
the control u. If is the solution of (Coll starting from 
an arbitrary initial condition then the value of is 

increasing along i.e., > 0. In other words, 

starting from an initial guess u^, we solve the following initial 
value problem 


ds 
.( 0 ) = 




( 11 ) 


Using (CH), we compute Jq[u + 5u) as follows 
J@{u + 8 u)-J@{u) 

Ki 291 ((r0(7’)|v/target)(rtarget|5v/(r)) 

= 291 ^ —/(y/©(7’)|l//target)(V/target|/o V{t) 8 u{t)dt |V^o)^ 

“ Jo 23 ((V43(2’)|'/target) ('/target|u(f)| V/jj)) (12) 

where 9I(-) and 3(-) denote, respectively, the real and 
imaginary parts of a complex number, and V(t) = 
U@(T)U^(t)fi(ei)HiU 0 (t). 

Recall also that the definition of the gradient implies that 

J 0 {u + 8 u)-j 0 {u) = (Vy0(M),5M)i2([o,ri)+o(ll^“ll) 

= jJ'VJ 0 {u) 8 u{t)dt + o{\\ 8 u\\). (18) 
Therefore, by identifying (fTTl i with (fTSl l. we obtain 


in order to And a control strategy which maximizes Jn- This 
initial value problem can be solved numerically by using a 
forward Euler method over the s-domain, i.e., 

u{s + As,t) = u{s,t) + (12) 

For practical applications, we present an iterative approx¬ 
imation version of the above algorithm to And the optimal 
controls u*{t) in an iterative learning way, where we use k 
as an index of iterations instead of the variable s and denote 
the control at iteration step k as u^{t). Equation (fTSl l can be 
rewritten as 

u'^+\t) = u\t) + ^kVJN{u’^), (13) 

where Tjj. is the updating step (learning rate) for the kth 
iteration. Using (0, we also have 

V7a,(m) = -^^V70„(m). (14) 

■''' n=\ 

Recall that /©(m) = |('/©(7’)|)/target)P and |t/ 0 (-)) satisfies 

= |v/©(0)) = |v/o). (15) 

We now derive an expression for the gradient of Jq{u) with 
respect to the control u by using a first order perturbation. Let 
8 \j/{t) be the modification of |'/(f)) induced by a perturbation 
of the control from u{t) to u{t) + 8u{t). By keeping only the 
first order terms, we obtain the equation satisfied by 5i/: 

— = {fQ{9Q)Ho + u{t)fi{9i)Hi) 8\j/ 

dt Ti 

-j^8u{t)fi{9\)Hi\^@{t)), 

8 \i/{0) =0. 

Let 17©(f) be the propagator corresponding to (fTSll . Then, 
t/©(f) satisfies 

^U0{t) = -jH0{t)U0{t), U{0)=I. 

at n 

Therefore, 

8xtf{T) = -jU0{T)8u{t)ul{t)h{9,)Hr\^f0{t))dt 

= -jU0{T) j\l{t)fi{9i)HiU0{t)8u{t)dt Iv/o). (16) 


V7©(m) = 23 (('/0(7’)|V4arget)('/target|V(f)|v/o)) • (19) 

The gradient flow method can be generalized to the case with 
M > 1 as shown in Algorithm 1. For a termination criterion 
of the iterative learning process, we use the following: if 
the change of the performance function for 100 consecutive 
iterations is less than a given small threshold e > 0 , i.e., 
— 7(i/)| < e, we end the learning process. In this 
paper we choose e = 10 ^^ for all numerical experiments. 


Algorithm 1. Gradient flow based iterative leai'ning 

1: Set the index of iterations k = 0 

2: Choose a set of arbitrary controls 1 /=*^ = {m® (f), m = 

1. 2 .. ..,M},re[ 0 ,r] 

3: repeat (for each iterative process) 

4: repeat (for each training sample « = 1,2,... ,77) 

5: Compute the propagator Uq (f) with the control 

strategy u^{t) 

6: until n=N 

7: repeat (for each control {m= 1,2,...,M) of the 

control vector u) 

8: 5Ut) = |lli3((V/„(r)|Ptarget<(0l'/0)) 

where Ptarget = I '/target) ('/target 15 (0 “ 

6^©„(2’)(U0^(f))l/m(0mn„,)7fmUQ^_(f) and rim S 
{l,2,...,iV„,} 

10: until m = M 

11: k — k \ 

12: until the learning process ends 

13: The optimal control strategy u* = {mJ),} = {«*,}, m = 

1 . 2 .. ..,M 


In practical applications, it is usually difficult to And the 
numerical solution to a time varying continuous control strat¬ 
egy u{t) using Algorithm 1. In simulation, we usually divide 
the time interval [0,7’] equally into a number of smaller 
time intervals Af and assume that the controls are constant 
within each At. Instead of f € [0,7’], the time index will be 
t„ = wT/W, where W = TjAt and w = 0,l,...,VT. 

In the following three sections, we apply the SEC method 
to three examples. The first example is the state preparation 
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in a general three-level quantum system where the main focus 
is on demonstrating the SLC method. We assume that there 
are no constraints on the control fields and the uncertainty 
parameters have uniform distributions or time-varying distri¬ 
butions. In the second example, we consider entanglement 
generation in superconducting quantum circuits. We use some 
practical models and relevant parameters in the literature. 
Bounded control fields and truncated Gaussian distributions 
for uncertainty parameters are assumed. The third example 
considers the application of the SLC method to a two-atom 
system interacting with a quantized field. 

IV. State preparation in three-level quantum 

SYSTEMS 

In this section, we demonstrate the application of the 
proposed SLC method to robust state preparation in a V-type 
three-level quantum system with uncertainties. V-type three- 
level systems are a typical class of quantum systems in atomic 
physics. Some natural and artificial atoms can be described 
by a V-type three-level model PVl . State preparation is an 
essential task in quantum information processing ll58l . For ex¬ 
ample, specific quantum states are required to be prepared for 
initialization in quantum computation and transfer in quantum 
communication. It is important to achieve robust preparation 
of these specific states for practical applications of quantum 
technology. For simplicity, we assume no constraints on the 
external controls and use atomic units (i.e., setting /I = 1 ) in 
this section. The aim is to show how to apply the proposed 
SLC method for robust control design of quantum systems 
with uncertainties. 


A. State preparation in a V-type quantum system 

We consider a V-type quantum system and demonstrate the 
SLC design process. Assume that the initial state is |i/(f)) = 
ci(f)|l)+C2(f)|2)+C3(f)|3). Let C(f) = (ci(f),C 2 (f),C 3 (f)) 
where the Ci(f)’s are complex numbers. We have 

M 

iCit) = iMeo)Ho + 52 fm{e,n)Umit)H,n)C{t). (20) 

m=l 


We take Hq = diag(L5,1,0) and choose Hi, H 2 , H^ and /Lj 
as follows Il62l : 


/ ® 

1 

0 \ 


( 0 

—i 

0 

1 

0 

0 

11 

i 

0 

0 

V 0 

0 

0 / 


\ 0 

0 

0 


/ ® 

0 

1 \ 

1 

( 0 

0 


0 

0 

0 

, H^=\ 

0 

0 

0 

V 1 

0 

0 / 


V i 

0 

0 


( 21 ) 


For simplicity, we assume fm{0m) = /(i^) for iw = 
1,2,3,4 and /o(0o) =/o(i^)- After we sample the uncertainty 
parameters, every sample can be described as follows; 


c\{t) \ / 

-1.5/o(d)i 

Gi(b) 

GiW \ 

/ Cl{t) 

C2{t) = 

G*iW 

-foWi 


cih) 

C3{t) / V 

cm 

0 

0 / 

V C3W 


( 22 ) 


where Gi{t}) = f{T})[u 2 {t) - iui{t)], G 2 (tJ) =/(tJ)[M4(f) “ 
/M 3 (f)] and t? € [1 —E,l -fF] . E G [0,1] is a given constant 
and G* is the complex conjugate of G. 

To construct an augmented system for the training step of 
the SLC design, we choose N training samples (denoted as 
n = 1,2,... ,N) through sampling the uncertainties as follows; 

/ ci,n{t) \ ( ci,„(f) \ 

C 2 ,„(f) C 2 ,„(f) , (23) 

V C3,n(0 / V C3,n(0 / 

/ -L5/o(t?„)* Gi(4) G 2 (t?„) \ 

Bn{t) = Gt(4) -MBn)i 0 

V 0 0 y 

where Gi{B„) = f{Bn)[u 2 {t) - iui{t)\, G 2 ( 0 „) = f {B„)[u 4 {t)- 
/M 3 (f)]. For simplicity, we assume that /o('!?) =/{'&) = have 
uniform distributions over [1 — £, 1 -\-E]. Now the objective is 
to find a robust control strategy u{t) = {um(t),m = 1,2,3,4} to 
drive the quantum system from ji/zb) = | 1 ) (i.e., Co = ( 1 , 0 , 0 )) 
to I V4arget) = + |3)) (i.C., Ctarget = (0, ^j))- 

If we write ( |2^ as Cn{t) = B„{t)Cn{t) (n= 1,2,...,A), we 
can construct the following augmented system 


/ Ci(0 \ 

Ciit) 


(Bi(t) 

0 

0 

B2(0 • 

■ " \ 
0 

( Ci{t) \ 
C2{t) 

y CN{t)) 


1 0 

0 

• Bv(f) ) 

V CN{t) ] 

(24) 


For this augmented system, we use the training step to learn 
an optimal control strategy u{t) to maximize the following 
performance function 


■^(") = 4Ll(C.(n|Ctarget)|2. (25) 

■''' n=l 

Now we employ Algorithm 1 to find an optimal control 
strategy u*(t) = {u*,^{t),m = 1 , 2 ,3,4} for the augmented sys¬ 
tem. Then we apply the optimal control strategy to additional 
samples to evaluate the performance of the control strategy. 


B. Numerical results 


For numerical experiments on a V-type quantum system, we 
use the parameter settings listed as follows; The initial state 
\\j/o) = | 1 ) and the target state jv^target) = y 5 (| 2 ) + |3)); The 
end time is T = 5 and the total time duration [0,r] is equally 
discretized into W = 200 time intervals with each time interval 

At = (tw — G-i)|»'=i .2 .w = T/W = 0.025; The learning rate 

is Tj*. = 0.2; The control strategy is initialized with u^'"^{t) = 
{m® (f) = sinf,m = 1 , 2 ,3,4}. 

First, we assume that there exists only the uncertainty /o(t?) 
(i.e., /(t?) = !),£’ = 0.21 and /o(t?) has a uniform distribution 
in the interval [0.79,1.21]. To construct an augmented system 
for the training step, we use the training samples for this V- 
type quantum system defined as follows 


/o(t>„) = 1-0.21 + 


0.21 ( 2 n-l) 


( 26 ) 
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Fig. 1. Training performance to find the optimal control strategy by 
maximizing J{ii) for the V-type quantum system with only uncertainty /o(i?) 
where /o(i>) € [0.79,1.21], 



Fig. 2. The learned optimal control strategy with maximized J{u) for 
the V-type quantum system with only the uncertainty /b(t?) where /()(i?) € 
[0.79,1.21]. 


where n = 1,2,...,7. The training performance for the aug¬ 
mented system is shown in Fig. 1. It is clear that the learning 
process converges to a quite accurate stage very quickly. The 
optimal control strategy is demonstrated in Fig. 2, which is 
compared with the initial one. To test the optimal control strat¬ 
egy obtained from the training step, we choose 200 samples 
obtained by sampling the uncertainty /o(t?) according to a 
uniform distribution and demonstrate the testing performance 
in Fig. 3. For the 200 tested samples, an average fidelity of 
0.9999 is achieved. 

Now, we consider the more general case where there 
exist the uncertainties /o(t?) and /(t?). Assume E = 0.21, 
/o(t?) = 1 — t^ocosf, /(t?) = 1 — tJcosf, and both t5o and t? 
have uniform distributions on the interval [—0.21,0.21]. To 
construct an augmented system for the training step, we use 
the training samples defined as follows 


/o(t?„) = 1-0.21 + 
/(t?„) = 1-0.21 + 


0.21(2fix(n/7)-l) 
7 ’ 

0.21(2mod(n,7)- 1) 


(27) 


where n = 1,2,... ,49, fix(x) = max{z G 1\z < x}, mod(«,7) = 
n — lz (z € Z and 7 — 1 <z< 7) and Z is the set of integers. 



200 


0) 

■o 




0.99. 


50 too 150 

Index of tested samples 


200 


Fig. 3. The testing performance (with respect to fidelity) of the learned 
optimal control strategy for the V-type quantum system with only uncertainty 
/b(i?) where /o(t?) € [0.79,1.21]. For the 200 tested samples, the average 
fidelity is 0.9999. 



Fig. 4. The learned optimal control strategy with maximized J(u) for the 
V-type quantum system with the uncertainties /o(t^) and /{t?) where /o(i?) = 
1 — i5o cost, /(i7) = 1 —cosr, and both and have uniform distributions 
on the interval [—0.21,0.21]. 


The algorithm converges after around 9000 iterations and the 
optimal control strategy is presented in Fig. 4. To test the 
optimal control strategy obtained in the training step, we 
randomly choose 200 samples by uniformly sampling the 
uncertainties and and an average fidelity of 0.9961 
is achieved. However, if we use only one sample (i.e., the 
nominal system) for training to obtain a control law, the 
testing performance shows a 0.9152 average fidelity. These 
numerical results show that the proposed SLC method using 
an augmented system for training is effective for control design 
of quantum systems with uncertainties. 
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V. Robust entanglement generation in quantum 

SUPERCONDUCTING CIRCUITS 

Superconducting quantum circuits based on Josephson junc¬ 
tions are macroscopic circuits which can behave quantum 
mechanically like artificial atoms 1501-1531. These artificial 
atoms can be used to test the laws of quantum mechanics 
on macroscopic systems and also offer a promising way 
to realize qubits in quantum information technology CD. 
Superconducting quantum circuits have been recognized as 
promising candidates for quantum information processing due 
to their advantages of scalability and design flexibility. They 
have been widely investigated theoretically and experimentally 
in recent years im, 1631-1701. Superconducting qubits can be 
controlled by adjusting external parameters such as currents, 
voltages and microwave photons, and the coupling between 
two superconducting qubits can be turned on and off at will 
Eol. In practical applications, the existence of noise (includ¬ 
ing extrinsic and intrinsic) and inaccuracies (e.g., inaccurate 
operation in the coupling between qubits) in superconducting 
quantum circuits is unavoidable. In this section, we apply the 
SLC method to robust control design for a superconducting 
circuit system with uncertainties. 

In superconducting quantum circuits, two typical classes of 
qubits are flux qubits and charge qubits which correspond 
to different ratios between the Josephson coupling energy 
Ej and the charging energy Ec (For a brief introduction to 
superconducting quantum circuits, see, e.g., ED, l69l)- The 
simplest charge qubit is based on a small superconducting 
island (called a Cooper-pair box) coupled to the outside world 
through a weak Josephson junction and driven by a voltage 
source through a gate capacitance within the charge regime 
(i.e., £c»£y) ED- In practical applications, the Josephson 
junction in the charge qubit is usually replaced by a dc 
superconducting quantum interference device (SQUID) with 
low inductance to make it easier to control the qubit. When 
we concentrate on a voltage range near a degeneracy point, 
the Hamiltonian of a superconducting charge qubit can be 
described as follows 

H = F,{yg)a,-F,{^)a^ (28) 

where F^iVg) is related to the charging energy Ec and this 
term can be adjusted through external parameters such as the 
voltage Vg, Fx{^) corresponds to a controllable term including 
different control parameters such as the flux <I> in the SQUID, 
and the Pauli matrices a = with 



In this section, we consider the coupled two-qubit circuit 
in 1^ where an LC-oscillator is used to couple two charge 
qubits (see Fig. 5). Each qubit is realized by a Cooper-pair 
box with Josephson coupling energy Eji and capacitance Cy, 
(; = 1,2). Each Cooper-pair box is biased by an applied voltage 
Vi through a gate capacitance C, (; = 1,2). The Hamiltonian 


of the coupled charge qubits can be described as Il69l 

H 0/(2) +/7 (y2)/(^) 0 (jf ( 

0/(2( -/i(02)/(^( 0 (jP (30) 

where A(-') denotes an operation A on the qubit j and 0 denotes 
the tensor product. Let ui{t) = F^{Vi)/h, 112 ( 1 ) = F^(V 2 )/h, 
U 3 (t)=Fx(^i)/Ti, M4(f) =/t(4>2)/^i, U5(t)=X(t)/^- For sim¬ 
plicity, we assume the uncertainty parameters fm{0m) = Om for 
all m = 1,2,3,4,5. The Hamiltonian for the practical system 
can be described as 

H/n 0/(2) -p d2U2(t)I^^'> 0 oP 

- 03M3(f)(7i^(0/(2)- 04M4(f)/(^(0(7i^( (31) 

- 05M5(f)(7i^(0CTP 

where 0^ € [1 —£, 1 -bE] (m = 1,2,3,4,5). 

Eor practical systems, Ej could be around 10 GHz and 
Ec could be around 100 GHz (e.g., the experiment in ED 
used Eji = 13.4 GHz, and Ec2 = 152 GHz). In OTT i. we 
assume Mi(f) € [0,50.2] GHz, U 2 {t) € [0,50.2] GHz, U 3 (t) € 
[0,11.1] GHz, M 4 (f) e [0,11.1] GHz, lM 5 (f)l <0.5 GHz, and 
the operation time T = 2 ns. As an example, we let the 
task be to generate a maximally entangled state [VAarget) = 
-^(\g\,g 2 ) + \e\,e 2 )), where Jgj) and \ej) denote the ground 
state and the excited state of qubit j, respectively. In quantum 
information, we usually use jO) (or jl)) to denote jg) (or je)). 

Quantum entanglement is a unique quantum phenomenon 
that occurs when quantum subsystems are generated or interact 
in ways such that the quantum state of each subsystem 
cannot be described independently ED, CD, CD- Quantum 
entanglement shows nonclassical correlation and has been 
demonstrated as an important physical resource in quantum 
cryptography, quantum communication and quantum compu¬ 
tation ll58l . CD- We may use concurrence to measure how en¬ 
tangled a two-qubit state is d . Eor a two-qubit state p, let p* 
denote the complex conjugate of p, p — {Gy®<Jy)p*(Gy®<Jy) 
and R = ^/y/pPy/P- Let /li,l 2 ,-^ 3,-^4 be the eigenvalues of R 
in decreasing order. The concurrence is defined as 

'^(p) = max(0,li —12 —-^3 —-^ 4 )- 

Let 01 = 02, 03 = 04 , 9j € [0.79,1.21]. In the training step, 
we uniformly select 7 values for each uncertainty parameter 
to generate samples for constructing an augmented system. 
In the testing step, we assume 9j has a truncated Gaussian 
distribution. We also assume jy/o) = \gi:g 2 )- 

In numerical experiments, we divide t G [0,2] ns equally into 
200 time intervals. The control fields are initialized as: mi(0) = 
M 2 ( 0 ) = M 3 ( 0 ) = 1 / 4 ( 0 ) = sinf 4-5 GHz, 1 / 5 (0) = 0.25sinf GHz. 
Assume the control fields satisfy \uj{t)\ < V. During the 
learning process, if the calculated control Uj > V using the 
gradient algorithm, we let u^j = V. Similarly, if the calculated 
control My < —y, we let My = —V. The learning algorithm 
converges after about 9800 iterations and the performance is 
shown in Eig. 6. A set of optimal control fields is shown in Eig. 
7. Then the learned optimal control fields are applied to 2000 





Fig. 6. Training performance to find the optimal control strategy by 
maximizing J{ii) for coupled qubits via an LC-oscillator when the uncertainty 
bound is £ = 0.21. 


samples that are generated through selecting different values 
of uncertainty parameters according to the truncated Gaussian 
distribution with mean ft = 1 and standard deviation v = 0.07 
within the interval of [1 —3v,l+3v] = [0.79,1.21]. The 
average concurrence is obtained from 2000 samples. When 
9i G [0.79,1.21], the testing process (using 2000 randomly 
selected samples) shows that the average fidelity is 0.9992 and 
the average concurrence is 0.9981. Hence, the learned control 
fields can still drive the system to a maximally entangled state 
with high concurrence when the uncertainty parameters have 
42% fluctuations. 

VI. Robust entanglement control between two 
ATOMS in a cavity 

A. The system 

In this section, we apply the SLC method to a quantum 
system consisting of two two-level atoms interacting with 
a quantized field in an optical cavity (see Fig. 8) or in 
a microwave cavity. This model has been wieldy used in 
experimental quantum optics and quantum information 
ES, ca, Ga, 1721. The two-qubit system can be represented 
using four basis vectors \g\,g 2 ), \ei,g 2 ), \g\,e 2 ) and lei,e 2 ) 
where \ej) denotes the excited state of the atom j and jgy) 
denotes the ground state of the atom j. The Hamiltonian which 
describes the two-atom system interacting with a quantized 
held can be written as follows 

+ ( 32 ) 


20 
N 

o 10 
= 0 

0 0.5 1 1.5 2 

20 
N 

o 

^ 0 

0 0.5 1 1.5 2 



t(ns) 


Fig. 7. The learned control field for the problem of coupled qubits via an 
LC-oscillator when the uncertainty bound is E = 0.21. 

Here, the first term in (l32] | 

^0 = T L + o^ra^a (33) 

^ !=1 

is the Hamiltonian describing the energy of the atoms and 
the quantized held. cp 4 , is the atomic transition frequency for 
atom /, and the operators represent the annihilation and 
creation operators. An annihilation operator lowers the number 
of particles in a given state by one. A creation operator is the 
adjoint of the annihilation operator. The second term 

2 2 

Hi = L ^ij ® + L + « cr+')) (34) 

j 

represents the interactions. The first term is the dipole-dipole 
interaction between the two qubits (atoms), where is the 
dipole-dipole interaction parameter, = \ei){gi\ and = 
\gi){ei\. Most atoms have attractive forces between each other 
due to fluctuation dipole moments when the electrons of an 
atom leave the positively charged nucleus unshielded. This is 
called dipole-dipole interaction ITS). The second term in the 
Hamiltonian in (i34l i represents the interaction between the held 
and the atoms, where Vj is the coupling constant between the 
atoms and the quantized held. The last term in the Hamiltonian 
given in ( l32b is the control Hamiltonian: 

2 . 2 , . 

77m = L + UmrO^a -f L UQ-ij ® 

'■=1 

2 

+ L “V ^ 3- ^). 

j 

The aim is to And functions Mo^,, to drive the 
quantum system to a particular target state with a desired 
level of fidelity even when uncertainties exist. The proposed 
control Hamiltonian includes several terms. The first two 
terms +U(a^a^a represent the control of the energy in 
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Quantized field 



Fig. 8. Schematic for two atoms interacting with a quantized field in a cavity. 

the system through the atomic transition frequency cUa, and 
field frequency (Or- The term <Si CT^'^ represents the 

change in the dipole-diploe interaction between the atoms, 
and can be controlled by changing the distance between 
the two atoms, or tuning the frequency of the driving field. 
The term Uyj{a'^+ aa^'^) represents the control of the 
interaction between the atoms and the field. In this paper, we 
let Ml(f) = “ 2(0 = Um,, 113 ( 1 ) = UQ.j, U 4 {t) = Uvi 

and M 5 (f) = Mv 2 - 

We consider that a steady number of photons is in the cavity. 
The state of the quantum system consisting of two atoms 
interacting with a quantized field in a cavity can be described 
as follows 

\v{t)) = + '^,81,82)+C2{t)\n+ 1,61,82) 

+ C3{t)\n+l,gi,e2) +C4{t)\n,ei,e2), 

where |n) is the number state of photons in the cavity and 
the complex coefficients ci(t),C 2 (t),C 3 (t) and C 4 (f) satisfy 

|ci(t)P + |c 2 ( 0 |" + k3(0P + k4(0P = l- 

We assume that the Hamiltonian with uncertainties can be 
written as follows: 

H{t) = OoHo + G,Hj + (35) 

where 0 q, Gj and Gu represent uncertainty parameters in the 
free Hamiltonian, the interaction Hamiltonian and the control 
Hamiltonian, respectively. We assume that the uncertain pa¬ 
rameters satisfy Gq € [1 — is,! +£], 0 / G [1 — 1 -f£] and 

0„e [!-£,!+£]. 

The density matrix of the system under consideration is 
given as follows: 

p{t) = \W)){w{t)\. (36) 

The density matrix carries information about the two subsys¬ 
tems of the atoms and the field. However, we are interested 
in the entanglement between the two atoms. Hence, the field 
needs to be traced out of the density matrix (l36l l. This task 
can be accomplished by a partial trace operation Tr/^ over the 
field (see, e.g., Il58l for a detailed description of the partial 
trace). 

Now, we define the performance function as follows 

-/(«) = Tr[^ (37) 



Fig. 9 . The learned control strategy, where the initial state is |i/'^( 0 )) = 
|gl,g2) and the target state [iK^gct) = (l«l.^2) + |gl,e2)). The uncertainty 
bound is £■ = 0 . 2 , ui[t) = ua>a, U2(t) = “3(^) = “Q. “4(f) = “vl and 

115(1) =llv2- 

where Pa{T) = Try[|t//(7’))(v/(r)|] is the density matrix of the 
two-atom subsystem at the end time T of the evolution, and 
Ptlrget = I v4get)(V'tergetl the target density matrix of the two- 
atom subsystem. During the learning process, this performance 
function is used to measure the fidelity of the system for a 
given control law. An optimal control law can be found by 
maximizing Jiu). 

B. Numerical results 

For the proposed two-qubit system (two atoms) interacting 
with a quantized electromagnetic field, we are interested in 
generating maximum entanglement |v 4 rget) = ■^{\^ti 82 ) + 
\8\+2)) between the two qubits (atoms). The parameters 
in atomic units are set as follows: The atomic transition 
frequencies are (tUi,CU 2 ) = (6.44,3.34) and the dipole-dipole 
interaction parameter is £ 2 i 2 = 0.0259. The same relative 
relationship between the atomic transition frequencies and the 
dipole-dipole interaction as that in the experiment in has 
been considered. The evaluation time is T = 2 and the interval 
[0,r] is discretized equally into W = 350 time steps, where 
At = ^. The learning rate is set as Tj^. = 0.1. The initial control 
law is assumed to be = sinf (/ = 1,2,--- ,5). 

The uncertainty parameters Go, 0/ and Gu are assumed to 
have a uniform distribution in the interval [1 — 1 -fF] with 

E = 0.2. We select 5 values for each uncertainty parameter 
to construct an augmented system. We assume that the five 
controls «„,(?) (m = 1,2,3,4,5) are permitted in the Hamil¬ 
tonian //(f). The initial state is chosen to be the ground 
state Ivf'^(O)) = |,gi,g 2 ) and the target state is chosen to be 
IV ) = ■^{\e\,82) + \8t+2))- The algorithm converges with 
around 8000 iterations. In the evaluation step, we select 
500 additional samples to test the control performance. The 
average fidelity we can achieve is 0.9966 and the average 
concurrence is 0.9880. Fig.|9]gives the learned control strategy 
Um{t) (m = 1 , 2 ,3,4,5). 

VII. Conclusion 

In this paper, we presented a systematic numerical method¬ 
ology for robust control design of quantum systems. The pro¬ 
posed sampling-based learning control (SLC) method includes 
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two steps of “training” and “testing”. In the training step, 
the control is learned using a gradient flow based learning 
algorithm for an augmented system constructed from samples. 
The learned control is evaluated for additional samples in the 
testing step. The proposed numerical method has been applied 
to three significant examples of quantum robust control in¬ 
cluding state preparation in a three-level system, entanglement 
generation in a superconducting quantum circuit and in a two- 
atom system interacting with a quantized held in a cavity. In 
these examples, we considered the uncertainty parameters to 
have uniform distributions, truncated Gaussian distributions 
or possibly time-varying distributions. However, numerical 
results showed that the uniform distribution is a sound choice 
for sampling the uncertainty parameters in the training step. 
Before we start the training step, we may first analyze the 
controllability of the nominal system (e.g., using Lie group 
and Lie algebra theory m, Il56l). Such an analysis may be 
difficult when we consider the constraints on control strengths 
and control durations. Even if we prove that the nominal 
system is not controllable, it may still be possible to achieve 
accurate state transfer between specific states that correspond 
to some useful practical applications. One advantage of the 
proposed method is that it is numerically tractable in achieving 
convergence since we can use a small number of samples (e.g., 
five or seven) for each uncertainty parameter in the training 
step to obtain excellent performance. Based on the training 
performance (whether the cost J is close to one), it is easy to 
verify when an optimal solution has been found. The results 
in this paper have demonstrated the effectiveness of the SLC 
method for control design of quantum systems even when the 
uncertainty parameters have quite large fluctuations. 
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